None
**Instruments Affected**: e.g., FGS, MIRI, NIRCam, NIRISS
This is the validation notebook for the background subtraction step as part of calwebb_image2. This step takes in a set of images and a set of background observations. If more than one background observation is given, they are combined into a sigma clipped mean before being subtracted from each of the science data images. For more information on the pipeline step visit the links below.
Step description: https://jwst-pipeline.readthedocs.io/en/latest/jwst/background_step/description.html
Pipeline code: https://github.com/spacetelescope/jwst/tree/master/jwst/background
The page describing the algorithm and any details can be found here:
https://outerspace.stsci.edu/display/JWSTCC/Vanilla+Imaging+Background+Subtraction
Here are some common terms that will be used throughout the notebook
JWST: James Webb Space Telescope
MIRI: Mid-Infrared Instrument
MIRISim: Simulator that creates pipeline ready MIRI simulated data
This test is performed by creating a set of simulated data with multiple point sources located at random locations across the MIRI field of view. There is a set of 4 simulated images at four dithered positions with 300+ stars and a galaxy in the MIRI field of view (including Lyot). This test also takes in a set of four simulated background images, at four dithered positions, with around 40 fainter stars across the field of view and Lyot mask. All images will be processed through calwebb_detector1, and put into an association file to be run through calwebb_image2. This will tell the background step which are the science observations and which are the background observations so that it will do a sigma clipped mean of the background exposures, then subtract the mean from each of the science observations.
The notebook shows the images (background, science, averaged background, and background subtracted) through the course of the notebook to demonstrate how well the algorithm works.
The set of data used in this particular test were created with the MIRI Data Simulator (MIRISim). There is a set of 4 simulated images at four dithered positions with 300+ stars and a galaxy in the MIRI field of view (including Lyot). This test also takes in a set of four simulated background images, at four dithered positions, with around 40 fainter stars across the field of view and Lyot mask. All of the images were created with the F770W filter.
The following cell sets up a temporary directory (using python's tempfile.TemporaryDirectory()), and changes the script's active directory into that directory (using python's os.chdir()). This is so that, when the notebook is run through, it will download files to (and create output files in) the temporary directory rather than in the notebook's directory. This makes cleanup significantly easier (since all output files are deleted when the notebook is shut down), and also means that different notebooks in the same directory won't interfere with each other when run by the automated webpage generation process.
If you want the notebook to generate output in the notebook's directory, simply don't run this cell.
If you have a file (or files) that are kept in the notebook's directory, and that the notebook needs to use while running, you can copy that file into the directory (the code to do so is present below, but commented out).
#****
#
# Set this variable to False to not use the temporary directory
#
#****
use_tempdir = True
# Create a temporary directory to hold notebook output, and change the working directory to that directory.
from tempfile import TemporaryDirectory
import os
import shutil
if use_tempdir:
data_dir = TemporaryDirectory()
# Save original directory
orig_dir = os.getcwd()
# Move to new directory
os.chdir(data_dir.name)
# For info, print out where the script is running
print("Running in {}".format(os.getcwd()))
Running in /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8
By default, the notebook template environment sets up its CRDS cache (the "CRDS_PATH" environment variable) in /grp/crds/cache. However, if the notebook is running on a local machine without a fast and reliable connection to central storage, it makes more sense to put the CRDS cache locally. Currently, the cell below offers several options, and will check the supplied boolean variables one at a time until one matches.
use_local_crds_cache is False, then the CRDS cache will be kept in /grp/crds/cacheuse_local_crds_cache is True, the CRDS cache will be kept locallycrds_cache_tempdir is True, the CRDS cache will be kept in the temporary directorycrds_cache_notebook_dir is True, the CRDS cache will be kept in the same directory as the notebook.crds_cache_home is True, the CRDS cache will be kept in $HOME/crds/cachecrds_cache_custom_dir is True, the CRDS cache will be kept in whatever is stored in the
crds_cache_dir_name variable.If the above cell (creating a temporary directory) is not run, then setting crds_cache_tempdir to True will store the CRDS cache in the notebook's directory (the same as setting crds_cache_notebook_dir to True).
import os
# Choose CRDS cache location
use_local_crds_cache = True
crds_cache_tempdir = False
crds_cache_notebook_dir = False
crds_cache_home = False
crds_cache_custom_dir = False
crds_cache_dir_name = ""
if use_local_crds_cache:
if crds_cache_tempdir:
os.environ['CRDS_PATH'] = os.path.join(os.getcwd(), "crds")
elif crds_cache_notebook_dir:
try:
os.environ['CRDS_PATH'] = os.path.join(orig_dir, "crds")
except Exception as e:
os.environ['CRDS_PATH'] = os.path.join(os.getcwd(), "crds")
elif crds_cache_home:
os.environ['CRDS_PATH'] = os.path.join(os.environ['HOME'], 'crds', 'cache')
elif crds_cache_custom_dir:
os.environ['CRDS_PATH'] = crds_cache_dir_name
List the package imports and why they are relevant to this notebook.
# import inspect
from astropy.io import fits
# from IPython.display import Markdown
from ci_watson.artifactory_helpers import get_bigdata
import glob
from jwst.datamodels import RampModel, ImageModel
from jwst.pipeline import Detector1Pipeline, Image2Pipeline
from jwst import associations
from jwst.associations.lib.rules_level2_base import DMSLevel2bBase
from jwst.associations import asn_from_list
from jwst.background import BackgroundStep
import matplotlib
import matplotlib.pyplot as plt
import numpy as np
from astropy.utils.data import download_file
from pathlib import Path
from shutil import move
from os.path import splitext
def get_box_files(file_list):
for box_url,file_name in file_list:
if 'https' not in box_url:
box_url = 'https://stsci.box.com/shared/static/' + box_url
downloaded_file = download_file(box_url)
if Path(file_name).suffix == '':
ext = splitext(box_url)[1]
file_name += ext
move(downloaded_file, file_name)
file_urls = ['https://stsci.box.com/shared/static/4i7z7q24rotc52m6bcr5ymekt2whuwto.fits',
'https://stsci.box.com/shared/static/0fsqi7diuejt4uosjsnqv2q9qx4g7zk4.fits',
'https://stsci.box.com/shared/static/kd1liugoruiz40v5u5bu19u68zn51iec.fits',
'https://stsci.box.com/shared/static/o0v5skb6ohnj8qdhk64b07kvgldn37e3.fits',
'https://stsci.box.com/shared/static/i30rmp4vz337j0qslbqn0sddraarpnl8.fits',
'https://stsci.box.com/shared/static/o6gsumrc7w2orqu4dlo3limi37pduxtg.fits',
'https://stsci.box.com/shared/static/075munkxxlk2g1009irs6zanjco2e2cq.fits',
'https://stsci.box.com/shared/static/ppdyqjud4g5u1eaksztyx5b8rl1bzzzp.fits']
files = ['starfield_med_seq1_MIRIMAGE_F770Wexp1.fits',
'starfield_med_seq2_MIRIMAGE_F770Wexp1.fits',
'starfield_med_seq3_MIRIMAGE_F770Wexp1.fits',
'starfield_med_seq4_MIRIMAGE_F770Wexp1.fits',
'bkg_faint_seq1_MIRIMAGE_F770Wexp1.fits',
'bkg_faint_seq2_MIRIMAGE_F770Wexp1.fits',
'bkg_faint_seq3_MIRIMAGE_F770Wexp1.fits',
'bkg_faint_seq4_MIRIMAGE_F770Wexp1.fits']
box_download_list = [(url,name) for url,name in zip(file_urls,files)]
get_box_files(box_download_list)
#This readnoise file is needed for use with simulated data which has higher readnoise than actual data.
readnoise = get_bigdata('jwst_validation_notebooks',
'validation_data',
'jump',
'jump_miri_test',
'jwst_mirisim_readnoise.fits')
print(files)
['starfield_med_seq1_MIRIMAGE_F770Wexp1.fits', 'starfield_med_seq2_MIRIMAGE_F770Wexp1.fits', 'starfield_med_seq3_MIRIMAGE_F770Wexp1.fits', 'starfield_med_seq4_MIRIMAGE_F770Wexp1.fits', 'bkg_faint_seq1_MIRIMAGE_F770Wexp1.fits', 'bkg_faint_seq2_MIRIMAGE_F770Wexp1.fits', 'bkg_faint_seq3_MIRIMAGE_F770Wexp1.fits', 'bkg_faint_seq4_MIRIMAGE_F770Wexp1.fits']
# Run the calwebb_detector1 pipeline
# set up pipeline parameters
rej_thresh=10.0 # rejection threshold for jump step
print('There are ', len(files), ' images.')
scislopelist = []
bkgslopelist = []
# loop over list of files
for file in files:
# set up pipeline parameters for input
pipe1 = Detector1Pipeline()
pipe1.jump.rejection_threshold = rej_thresh
pipe1.jump.override_readnoise = readnoise
pipe1.ramp_fit.override_readnoise = readnoise
pipe1.refpix.skip = True # needs update to simulator for this to work properly with simulated data
# set up output file name
base, remainder = file.split('.')
outname = base
#pipe1.jump.output_file = outname+'.fits'
#pipe1.ramp_fit.output_file = outname+'.fits'
pipe1.output_file = outname+'.fits'
# Run pipeline on each file
rampfile = pipe1.run(file)
if 'starfield' in file:
scislopelist.append(rampfile)
else:
bkgslopelist.append(rampfile)
print('Detector 1 steps completed on all files.')
print('Science files: ', scislopelist)
print('Background files: ', bkgslopelist)
2021-10-29 20:44:44,143 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2021-10-29 20:44:44,145 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2021-10-29 20:44:44,146 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2021-10-29 20:44:44,148 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2021-10-29 20:44:44,149 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2021-10-29 20:44:44,150 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2021-10-29 20:44:44,152 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2021-10-29 20:44:44,153 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2021-10-29 20:44:44,154 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2021-10-29 20:44:44,156 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2021-10-29 20:44:44,157 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2021-10-29 20:44:44,158 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2021-10-29 20:44:44,160 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2021-10-29 20:44:44,161 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2021-10-29 20:44:44,162 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2021-10-29 20:44:44,164 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2021-10-29 20:44:44,165 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2021-10-29 20:44:44,382 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('starfield_med_seq1_MIRIMAGE_F770Wexp1.fits',).
There are 8 images.
2021-10-29 20:44:44,392 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/starfield_med_seq1_MIRIMAGE_F770Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2021-10-29 20:44:45,041 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'starfield_med_seq1_MIRIMAGE_F770Wexp1.fits' reftypes = ['dark', 'gain', 'ipc', 'linearity', 'mask', 'persat', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2021-10-29 20:44:45,319 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits'.
2021-10-29 20:44:45,322 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits'.
2021-10-29 20:44:45,324 - stpipe.Detector1Pipeline - INFO - Prefetch for IPC reference file is '/grp/crds/cache/references/jwst/jwst_miri_ipc_0009.fits'.
2021-10-29 20:44:45,328 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits'.
2021-10-29 20:44:45,331 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits'.
2021-10-29 20:44:45,333 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2021-10-29 20:44:45,334 - stpipe.Detector1Pipeline - INFO - Override for READNOISE reference file is '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/jwst_mirisim_readnoise.fits'.
2021-10-29 20:44:45,336 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is '/grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits'.
2021-10-29 20:44:45,338 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is '/grp/crds/cache/references/jwst/jwst_miri_rscd_0010.fits'.
2021-10-29 20:44:45,341 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits'.
2021-10-29 20:44:45,343 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is 'N/A'.
2021-10-29 20:44:45,344 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2021-10-29 20:44:45,345 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2021-10-29 20:44:45,346 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2021-10-29 20:44:45,860 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:44:45,862 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:44:46,307 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES=1 is a power of 2; correction not needed
2021-10-29 20:44:46,309 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2021-10-29 20:44:46,310 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2021-10-29 20:44:46,403 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:44:46,405 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:44:46,424 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits
2021-10-29 20:44:47,018 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2021-10-29 20:44:47,179 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:44:47,181 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:44:47,202 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits
2021-10-29 20:44:48,189 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 saturated pixels
2021-10-29 20:44:48,258 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2021-10-29 20:44:48,264 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2021-10-29 20:44:48,415 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:44:48,418 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:44:48,438 - stpipe.Detector1Pipeline.ipc - INFO - Using IPC reference file /grp/crds/cache/references/jwst/jwst_miri_ipc_0009.fits
2021-10-29 20:44:50,206 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2021-10-29 20:44:50,353 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:44:50,355 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:44:50,889 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe done
2021-10-29 20:44:51,033 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:44:51,035 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:44:51,496 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe done
2021-10-29 20:44:51,638 - stpipe.Detector1Pipeline.reset - INFO - Step reset running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:44:51,640 - stpipe.Detector1Pipeline.reset - INFO - Step reset parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:44:51,660 - stpipe.Detector1Pipeline.reset - INFO - Using RESET reference file /grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits
2021-10-29 20:44:52,413 - stpipe.Detector1Pipeline.reset - INFO - Step reset done
2021-10-29 20:44:52,574 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:44:52,576 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:44:52,595 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits
2021-10-29 20:44:53,754 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2021-10-29 20:44:53,896 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:44:53,897 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}
2021-10-29 20:44:53,916 - stpipe.Detector1Pipeline.rscd - INFO - Using RSCD reference file /grp/crds/cache/references/jwst/jwst_miri_rscd_0010.fits
2021-10-29 20:44:54,399 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd done
2021-10-29 20:44:54,551 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:44:54,553 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}
2021-10-29 20:44:54,572 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits
2021-10-29 20:44:56,756 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=3, ngroups=20, nframes=1, groupgap=0
2021-10-29 20:44:56,757 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=2, ngroups=200, nframes=1, groupgap=0
2021-10-29 20:44:57,999 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2021-10-29 20:44:58,390 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:44:58,392 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2021-10-29 20:44:58,393 - stpipe.Detector1Pipeline.refpix - INFO - Step skipped.
2021-10-29 20:44:58,395 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2021-10-29 20:44:58,486 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:44:58,487 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}
2021-10-29 20:44:58,496 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 10 sigma
2021-10-29 20:44:58,508 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2021-10-29 20:44:58,525 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/jwst_mirisim_readnoise.fits
2021-10-29 20:44:58,541 - stpipe.Detector1Pipeline.jump - INFO - Using 1 core for jump detection
2021-10-29 20:44:59,151 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2021-10-29 20:45:00,214 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2021-10-29 20:45:01,413 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 2173 pixels with at least one CR and at least four groups
2021-10-29 20:45:01,414 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and three groups
2021-10-29 20:45:01,415 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and two groups
2021-10-29 20:45:01,578 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 2:
2021-10-29 20:45:02,724 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 1782 pixels with at least one CR and at least four groups
2021-10-29 20:45:02,725 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and three groups
2021-10-29 20:45:02,726 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and two groups
2021-10-29 20:45:02,887 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 3:
2021-10-29 20:45:03,983 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 1670 pixels with at least one CR and at least four groups
2021-10-29 20:45:03,985 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and three groups
2021-10-29 20:45:03,985 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and two groups
2021-10-29 20:45:04,194 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 5.04157 sec
2021-10-29 20:45:04,197 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 5.700758
2021-10-29 20:45:04,200 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2021-10-29 20:45:04,351 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:45:04,353 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2021-10-29 20:45:04,373 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/jwst_mirisim_readnoise.fits
2021-10-29 20:45:04,389 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2021-10-29 20:45:04,406 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2021-10-29 20:45:04,406 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2021-10-29 20:45:04,425 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of leading groups that are flagged as DO_NOT_USE: 1
2021-10-29 20:45:04,426 - stpipe.Detector1Pipeline.ramp_fit - INFO - MIRI dataset has all pixels in the final group flagged as DO_NOT_USE.
2021-10-29 20:45:50,561 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 18
2021-10-29 20:45:50,564 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 3
2021-10-29 20:45:50,680 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2021-10-29 20:45:50,851 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(1024, 1032) from starfield_med_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:45:50,853 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:45:50,904 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-10-29 20:45:50,905 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-10-29 20:45:50,913 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-10-29 20:45:51,002 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(3, 1024, 1032) from starfield_med_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:45:51,004 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:45:51,042 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-10-29 20:45:51,043 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-10-29 20:45:51,046 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-10-29 20:45:51,157 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_med_seq1_MIRIMAGE_F770Wexp1_rateints.fits
2021-10-29 20:45:51,159 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2021-10-29 20:45:51,223 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_med_seq1_MIRIMAGE_F770Wexp1_rate.fits
2021-10-29 20:45:51,224 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2021-10-29 20:45:51,232 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2021-10-29 20:45:51,234 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2021-10-29 20:45:51,236 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2021-10-29 20:45:51,237 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2021-10-29 20:45:51,239 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2021-10-29 20:45:51,241 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2021-10-29 20:45:51,243 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2021-10-29 20:45:51,244 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2021-10-29 20:45:51,246 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2021-10-29 20:45:51,248 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2021-10-29 20:45:51,249 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2021-10-29 20:45:51,251 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2021-10-29 20:45:51,252 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2021-10-29 20:45:51,254 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2021-10-29 20:45:51,256 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2021-10-29 20:45:51,258 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2021-10-29 20:45:51,261 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2021-10-29 20:45:51,402 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('starfield_med_seq2_MIRIMAGE_F770Wexp1.fits',).
2021-10-29 20:45:51,412 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/starfield_med_seq2_MIRIMAGE_F770Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2021-10-29 20:45:51,771 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'starfield_med_seq2_MIRIMAGE_F770Wexp1.fits' reftypes = ['dark', 'gain', 'ipc', 'linearity', 'mask', 'persat', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2021-10-29 20:45:51,782 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits'.
2021-10-29 20:45:51,785 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits'.
2021-10-29 20:45:51,787 - stpipe.Detector1Pipeline - INFO - Prefetch for IPC reference file is '/grp/crds/cache/references/jwst/jwst_miri_ipc_0009.fits'.
2021-10-29 20:45:51,789 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits'.
2021-10-29 20:45:51,793 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits'.
2021-10-29 20:45:51,795 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2021-10-29 20:45:51,797 - stpipe.Detector1Pipeline - INFO - Override for READNOISE reference file is '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/jwst_mirisim_readnoise.fits'.
2021-10-29 20:45:51,798 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is '/grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits'.
2021-10-29 20:45:51,800 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is '/grp/crds/cache/references/jwst/jwst_miri_rscd_0010.fits'.
2021-10-29 20:45:51,803 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits'.
2021-10-29 20:45:51,806 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is 'N/A'.
2021-10-29 20:45:51,807 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2021-10-29 20:45:51,808 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2021-10-29 20:45:51,809 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2021-10-29 20:45:52,294 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:45:52,297 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:45:52,688 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES=1 is a power of 2; correction not needed
2021-10-29 20:45:52,689 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2021-10-29 20:45:52,691 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2021-10-29 20:45:52,777 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:45:52,779 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:45:52,800 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits
2021-10-29 20:45:53,386 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2021-10-29 20:45:53,516 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:45:53,518 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:45:53,538 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits
2021-10-29 20:45:54,427 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 saturated pixels
2021-10-29 20:45:54,488 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2021-10-29 20:45:54,494 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2021-10-29 20:45:54,628 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:45:54,631 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:45:54,650 - stpipe.Detector1Pipeline.ipc - INFO - Using IPC reference file /grp/crds/cache/references/jwst/jwst_miri_ipc_0009.fits
2021-10-29 20:45:56,373 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2021-10-29 20:45:56,505 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:45:56,507 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:45:56,903 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe done
2021-10-29 20:45:57,041 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:45:57,043 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:45:57,493 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe done
2021-10-29 20:45:57,623 - stpipe.Detector1Pipeline.reset - INFO - Step reset running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:45:57,625 - stpipe.Detector1Pipeline.reset - INFO - Step reset parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:45:57,648 - stpipe.Detector1Pipeline.reset - INFO - Using RESET reference file /grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits
2021-10-29 20:45:58,349 - stpipe.Detector1Pipeline.reset - INFO - Step reset done
2021-10-29 20:45:58,498 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:45:58,500 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:45:58,520 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits
2021-10-29 20:45:59,699 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2021-10-29 20:45:59,838 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:45:59,840 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}
2021-10-29 20:45:59,860 - stpipe.Detector1Pipeline.rscd - INFO - Using RSCD reference file /grp/crds/cache/references/jwst/jwst_miri_rscd_0010.fits
2021-10-29 20:46:00,316 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd done
2021-10-29 20:46:00,448 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:46:00,450 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}
2021-10-29 20:46:00,473 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits
2021-10-29 20:46:02,480 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=3, ngroups=20, nframes=1, groupgap=0
2021-10-29 20:46:02,481 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=2, ngroups=200, nframes=1, groupgap=0
2021-10-29 20:46:03,640 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2021-10-29 20:46:03,996 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:46:03,999 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2021-10-29 20:46:04,000 - stpipe.Detector1Pipeline.refpix - INFO - Step skipped.
2021-10-29 20:46:04,003 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2021-10-29 20:46:04,091 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:46:04,092 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}
2021-10-29 20:46:04,101 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 10 sigma
2021-10-29 20:46:04,113 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2021-10-29 20:46:04,129 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/jwst_mirisim_readnoise.fits
2021-10-29 20:46:04,147 - stpipe.Detector1Pipeline.jump - INFO - Using 1 core for jump detection
2021-10-29 20:46:04,756 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2021-10-29 20:46:05,811 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2021-10-29 20:46:06,992 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 2062 pixels with at least one CR and at least four groups
2021-10-29 20:46:06,993 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and three groups
2021-10-29 20:46:06,994 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and two groups
2021-10-29 20:46:07,157 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 2:
2021-10-29 20:46:08,227 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 1840 pixels with at least one CR and at least four groups
2021-10-29 20:46:08,228 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and three groups
2021-10-29 20:46:08,229 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and two groups
2021-10-29 20:46:08,397 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 3:
2021-10-29 20:46:09,458 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 1869 pixels with at least one CR and at least four groups
2021-10-29 20:46:09,459 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and three groups
2021-10-29 20:46:09,460 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and two groups
2021-10-29 20:46:09,679 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 4.9217 sec
2021-10-29 20:46:09,682 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 5.580393
2021-10-29 20:46:09,685 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2021-10-29 20:46:09,811 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:46:09,813 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2021-10-29 20:46:09,832 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/jwst_mirisim_readnoise.fits
2021-10-29 20:46:09,849 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2021-10-29 20:46:09,872 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2021-10-29 20:46:09,873 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2021-10-29 20:46:09,891 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of leading groups that are flagged as DO_NOT_USE: 1
2021-10-29 20:46:09,893 - stpipe.Detector1Pipeline.ramp_fit - INFO - MIRI dataset has all pixels in the final group flagged as DO_NOT_USE.
2021-10-29 20:46:57,379 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 18
2021-10-29 20:46:57,381 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 3
2021-10-29 20:46:57,491 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2021-10-29 20:46:57,657 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(1024, 1032) from starfield_med_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:46:57,660 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:46:57,701 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-10-29 20:46:57,703 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-10-29 20:46:57,705 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-10-29 20:46:57,792 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(3, 1024, 1032) from starfield_med_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:46:57,794 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:46:57,826 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-10-29 20:46:57,827 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-10-29 20:46:57,830 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-10-29 20:46:57,936 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_med_seq2_MIRIMAGE_F770Wexp1_rateints.fits
2021-10-29 20:46:57,938 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2021-10-29 20:46:58,003 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_med_seq2_MIRIMAGE_F770Wexp1_rate.fits
2021-10-29 20:46:58,004 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2021-10-29 20:46:58,012 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2021-10-29 20:46:58,015 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2021-10-29 20:46:58,017 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2021-10-29 20:46:58,019 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2021-10-29 20:46:58,021 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2021-10-29 20:46:58,023 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2021-10-29 20:46:58,025 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2021-10-29 20:46:58,026 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2021-10-29 20:46:58,028 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2021-10-29 20:46:58,030 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2021-10-29 20:46:58,031 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2021-10-29 20:46:58,034 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2021-10-29 20:46:58,036 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2021-10-29 20:46:58,038 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2021-10-29 20:46:58,041 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2021-10-29 20:46:58,043 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2021-10-29 20:46:58,045 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2021-10-29 20:46:58,177 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('starfield_med_seq3_MIRIMAGE_F770Wexp1.fits',).
2021-10-29 20:46:58,188 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/starfield_med_seq3_MIRIMAGE_F770Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2021-10-29 20:46:58,519 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'starfield_med_seq3_MIRIMAGE_F770Wexp1.fits' reftypes = ['dark', 'gain', 'ipc', 'linearity', 'mask', 'persat', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2021-10-29 20:46:58,530 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits'.
2021-10-29 20:46:58,533 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits'.
2021-10-29 20:46:58,534 - stpipe.Detector1Pipeline - INFO - Prefetch for IPC reference file is '/grp/crds/cache/references/jwst/jwst_miri_ipc_0009.fits'.
2021-10-29 20:46:58,536 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits'.
2021-10-29 20:46:58,539 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits'.
2021-10-29 20:46:58,541 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2021-10-29 20:46:58,542 - stpipe.Detector1Pipeline - INFO - Override for READNOISE reference file is '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/jwst_mirisim_readnoise.fits'.
2021-10-29 20:46:58,544 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is '/grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits'.
2021-10-29 20:46:58,547 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is '/grp/crds/cache/references/jwst/jwst_miri_rscd_0010.fits'.
2021-10-29 20:46:58,549 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits'.
2021-10-29 20:46:58,551 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is 'N/A'.
2021-10-29 20:46:58,552 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2021-10-29 20:46:58,553 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2021-10-29 20:46:58,554 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2021-10-29 20:46:58,981 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:46:58,983 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:46:59,383 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES=1 is a power of 2; correction not needed
2021-10-29 20:46:59,384 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2021-10-29 20:46:59,386 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2021-10-29 20:46:59,477 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:46:59,479 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:46:59,498 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits
2021-10-29 20:47:00,057 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2021-10-29 20:47:00,189 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:47:00,191 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:47:00,210 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits
2021-10-29 20:47:01,108 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 saturated pixels
2021-10-29 20:47:01,170 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2021-10-29 20:47:01,175 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2021-10-29 20:47:01,305 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:47:01,307 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:47:01,326 - stpipe.Detector1Pipeline.ipc - INFO - Using IPC reference file /grp/crds/cache/references/jwst/jwst_miri_ipc_0009.fits
2021-10-29 20:47:02,982 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2021-10-29 20:47:03,113 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:47:03,117 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:47:03,527 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe done
2021-10-29 20:47:03,657 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:47:03,659 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:47:04,087 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe done
2021-10-29 20:47:04,215 - stpipe.Detector1Pipeline.reset - INFO - Step reset running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:47:04,217 - stpipe.Detector1Pipeline.reset - INFO - Step reset parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:47:04,237 - stpipe.Detector1Pipeline.reset - INFO - Using RESET reference file /grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits
2021-10-29 20:47:04,920 - stpipe.Detector1Pipeline.reset - INFO - Step reset done
2021-10-29 20:47:05,068 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:47:05,070 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:47:05,089 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits
2021-10-29 20:47:06,248 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2021-10-29 20:47:06,379 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:47:06,381 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}
2021-10-29 20:47:06,400 - stpipe.Detector1Pipeline.rscd - INFO - Using RSCD reference file /grp/crds/cache/references/jwst/jwst_miri_rscd_0010.fits
2021-10-29 20:47:06,835 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd done
2021-10-29 20:47:06,976 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:47:06,978 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}
2021-10-29 20:47:06,997 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits
2021-10-29 20:47:09,031 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=3, ngroups=20, nframes=1, groupgap=0
2021-10-29 20:47:09,032 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=2, ngroups=200, nframes=1, groupgap=0
2021-10-29 20:47:10,186 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2021-10-29 20:47:10,536 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:47:10,539 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2021-10-29 20:47:10,540 - stpipe.Detector1Pipeline.refpix - INFO - Step skipped.
2021-10-29 20:47:10,542 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2021-10-29 20:47:10,653 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:47:10,656 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}
2021-10-29 20:47:10,667 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 10 sigma
2021-10-29 20:47:10,678 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2021-10-29 20:47:10,695 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/jwst_mirisim_readnoise.fits
2021-10-29 20:47:10,710 - stpipe.Detector1Pipeline.jump - INFO - Using 1 core for jump detection
2021-10-29 20:47:11,286 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2021-10-29 20:47:12,334 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2021-10-29 20:47:13,507 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 1928 pixels with at least one CR and at least four groups
2021-10-29 20:47:13,508 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and three groups
2021-10-29 20:47:13,509 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and two groups
2021-10-29 20:47:13,673 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 2:
2021-10-29 20:47:14,729 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 1879 pixels with at least one CR and at least four groups
2021-10-29 20:47:14,731 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and three groups
2021-10-29 20:47:14,732 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and two groups
2021-10-29 20:47:14,907 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 3:
2021-10-29 20:47:15,961 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 1826 pixels with at least one CR and at least four groups
2021-10-29 20:47:15,963 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and three groups
2021-10-29 20:47:15,964 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and two groups
2021-10-29 20:47:16,177 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 4.88951 sec
2021-10-29 20:47:16,180 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 5.513289
2021-10-29 20:47:16,183 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2021-10-29 20:47:16,309 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:47:16,311 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2021-10-29 20:47:16,333 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/jwst_mirisim_readnoise.fits
2021-10-29 20:47:16,352 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2021-10-29 20:47:16,368 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2021-10-29 20:47:16,369 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2021-10-29 20:47:16,386 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of leading groups that are flagged as DO_NOT_USE: 1
2021-10-29 20:47:16,388 - stpipe.Detector1Pipeline.ramp_fit - INFO - MIRI dataset has all pixels in the final group flagged as DO_NOT_USE.
2021-10-29 20:48:03,459 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 18
2021-10-29 20:48:03,462 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 3
2021-10-29 20:48:03,562 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2021-10-29 20:48:03,701 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(1024, 1032) from starfield_med_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:48:03,703 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:48:03,742 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-10-29 20:48:03,744 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-10-29 20:48:03,746 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-10-29 20:48:03,837 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(3, 1024, 1032) from starfield_med_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:48:03,839 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:48:03,878 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-10-29 20:48:03,879 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-10-29 20:48:03,882 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-10-29 20:48:03,987 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_med_seq3_MIRIMAGE_F770Wexp1_rateints.fits
2021-10-29 20:48:03,989 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2021-10-29 20:48:04,051 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_med_seq3_MIRIMAGE_F770Wexp1_rate.fits
2021-10-29 20:48:04,052 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2021-10-29 20:48:04,060 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2021-10-29 20:48:04,062 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2021-10-29 20:48:04,063 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2021-10-29 20:48:04,065 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2021-10-29 20:48:04,066 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2021-10-29 20:48:04,068 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2021-10-29 20:48:04,069 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2021-10-29 20:48:04,071 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2021-10-29 20:48:04,072 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2021-10-29 20:48:04,074 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2021-10-29 20:48:04,075 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2021-10-29 20:48:04,077 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2021-10-29 20:48:04,078 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2021-10-29 20:48:04,080 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2021-10-29 20:48:04,081 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2021-10-29 20:48:04,083 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2021-10-29 20:48:04,084 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2021-10-29 20:48:04,216 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('starfield_med_seq4_MIRIMAGE_F770Wexp1.fits',).
2021-10-29 20:48:04,226 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/starfield_med_seq4_MIRIMAGE_F770Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2021-10-29 20:48:04,563 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'starfield_med_seq4_MIRIMAGE_F770Wexp1.fits' reftypes = ['dark', 'gain', 'ipc', 'linearity', 'mask', 'persat', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2021-10-29 20:48:04,572 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits'.
2021-10-29 20:48:04,574 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits'.
2021-10-29 20:48:04,577 - stpipe.Detector1Pipeline - INFO - Prefetch for IPC reference file is '/grp/crds/cache/references/jwst/jwst_miri_ipc_0009.fits'.
2021-10-29 20:48:04,581 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits'.
2021-10-29 20:48:04,584 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits'.
2021-10-29 20:48:04,587 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2021-10-29 20:48:04,589 - stpipe.Detector1Pipeline - INFO - Override for READNOISE reference file is '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/jwst_mirisim_readnoise.fits'.
2021-10-29 20:48:04,590 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is '/grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits'.
2021-10-29 20:48:04,593 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is '/grp/crds/cache/references/jwst/jwst_miri_rscd_0010.fits'.
2021-10-29 20:48:04,595 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits'.
2021-10-29 20:48:04,602 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is 'N/A'.
2021-10-29 20:48:04,603 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2021-10-29 20:48:04,604 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2021-10-29 20:48:04,605 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2021-10-29 20:48:05,065 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:48:05,067 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:48:05,465 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES=1 is a power of 2; correction not needed
2021-10-29 20:48:05,466 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2021-10-29 20:48:05,468 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2021-10-29 20:48:05,559 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:48:05,561 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:48:05,579 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits
2021-10-29 20:48:06,138 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2021-10-29 20:48:06,268 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:48:06,270 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:48:06,289 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits
2021-10-29 20:48:07,181 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 saturated pixels
2021-10-29 20:48:07,243 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2021-10-29 20:48:07,248 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2021-10-29 20:48:07,376 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:48:07,378 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:48:07,400 - stpipe.Detector1Pipeline.ipc - INFO - Using IPC reference file /grp/crds/cache/references/jwst/jwst_miri_ipc_0009.fits
2021-10-29 20:48:09,092 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2021-10-29 20:48:09,224 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:48:09,227 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:48:09,639 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe done
2021-10-29 20:48:09,766 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:48:09,768 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:48:10,169 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe done
2021-10-29 20:48:10,298 - stpipe.Detector1Pipeline.reset - INFO - Step reset running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:48:10,301 - stpipe.Detector1Pipeline.reset - INFO - Step reset parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:48:10,320 - stpipe.Detector1Pipeline.reset - INFO - Using RESET reference file /grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits
2021-10-29 20:48:11,004 - stpipe.Detector1Pipeline.reset - INFO - Step reset done
2021-10-29 20:48:11,151 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:48:11,153 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:48:11,174 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits
2021-10-29 20:48:12,354 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2021-10-29 20:48:12,492 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:48:12,494 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}
2021-10-29 20:48:12,513 - stpipe.Detector1Pipeline.rscd - INFO - Using RSCD reference file /grp/crds/cache/references/jwst/jwst_miri_rscd_0010.fits
2021-10-29 20:48:12,949 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd done
2021-10-29 20:48:13,083 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:48:13,085 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}
2021-10-29 20:48:13,104 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits
2021-10-29 20:48:15,110 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=3, ngroups=20, nframes=1, groupgap=0
2021-10-29 20:48:15,112 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=2, ngroups=200, nframes=1, groupgap=0
2021-10-29 20:48:16,259 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2021-10-29 20:48:16,608 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:48:16,611 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2021-10-29 20:48:16,611 - stpipe.Detector1Pipeline.refpix - INFO - Step skipped.
2021-10-29 20:48:16,613 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2021-10-29 20:48:16,702 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:48:16,704 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}
2021-10-29 20:48:16,715 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 10 sigma
2021-10-29 20:48:16,727 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2021-10-29 20:48:16,743 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/jwst_mirisim_readnoise.fits
2021-10-29 20:48:16,758 - stpipe.Detector1Pipeline.jump - INFO - Using 1 core for jump detection
2021-10-29 20:48:17,318 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2021-10-29 20:48:18,371 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2021-10-29 20:48:19,514 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 2112 pixels with at least one CR and at least four groups
2021-10-29 20:48:19,516 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and three groups
2021-10-29 20:48:19,517 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and two groups
2021-10-29 20:48:19,672 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 2:
2021-10-29 20:48:20,739 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 1951 pixels with at least one CR and at least four groups
2021-10-29 20:48:20,742 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and three groups
2021-10-29 20:48:20,743 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and two groups
2021-10-29 20:48:20,910 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 3:
2021-10-29 20:48:21,973 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 1757 pixels with at least one CR and at least four groups
2021-10-29 20:48:21,974 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and three groups
2021-10-29 20:48:21,975 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and two groups
2021-10-29 20:48:22,179 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 4.85967 sec
2021-10-29 20:48:22,182 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 5.467571
2021-10-29 20:48:22,186 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2021-10-29 20:48:22,329 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(3, 20, 1024, 1032) from starfield_med_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:48:22,331 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2021-10-29 20:48:22,351 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/jwst_mirisim_readnoise.fits
2021-10-29 20:48:22,367 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2021-10-29 20:48:22,384 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2021-10-29 20:48:22,385 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2021-10-29 20:48:22,403 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of leading groups that are flagged as DO_NOT_USE: 1
2021-10-29 20:48:22,404 - stpipe.Detector1Pipeline.ramp_fit - INFO - MIRI dataset has all pixels in the final group flagged as DO_NOT_USE.
2021-10-29 20:49:09,666 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 18
2021-10-29 20:49:09,668 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 3
2021-10-29 20:49:09,769 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2021-10-29 20:49:09,912 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(1024, 1032) from starfield_med_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:49:09,913 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:49:09,955 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-10-29 20:49:09,956 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-10-29 20:49:09,959 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-10-29 20:49:10,048 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(3, 1024, 1032) from starfield_med_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:49:10,050 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:49:10,083 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-10-29 20:49:10,083 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-10-29 20:49:10,087 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-10-29 20:49:10,200 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_med_seq4_MIRIMAGE_F770Wexp1_rateints.fits
2021-10-29 20:49:10,202 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2021-10-29 20:49:10,265 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_med_seq4_MIRIMAGE_F770Wexp1_rate.fits
2021-10-29 20:49:10,266 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2021-10-29 20:49:10,275 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2021-10-29 20:49:10,277 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2021-10-29 20:49:10,278 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2021-10-29 20:49:10,280 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2021-10-29 20:49:10,281 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2021-10-29 20:49:10,283 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2021-10-29 20:49:10,284 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2021-10-29 20:49:10,286 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2021-10-29 20:49:10,287 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2021-10-29 20:49:10,289 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2021-10-29 20:49:10,292 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2021-10-29 20:49:10,294 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2021-10-29 20:49:10,296 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2021-10-29 20:49:10,298 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2021-10-29 20:49:10,301 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2021-10-29 20:49:10,303 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2021-10-29 20:49:10,304 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2021-10-29 20:49:10,431 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('bkg_faint_seq1_MIRIMAGE_F770Wexp1.fits',).
2021-10-29 20:49:10,442 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/bkg_faint_seq1_MIRIMAGE_F770Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2021-10-29 20:49:10,825 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'bkg_faint_seq1_MIRIMAGE_F770Wexp1.fits' reftypes = ['dark', 'gain', 'ipc', 'linearity', 'mask', 'persat', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2021-10-29 20:49:10,839 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits'.
2021-10-29 20:49:10,842 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits'.
2021-10-29 20:49:10,844 - stpipe.Detector1Pipeline - INFO - Prefetch for IPC reference file is '/grp/crds/cache/references/jwst/jwst_miri_ipc_0009.fits'.
2021-10-29 20:49:10,846 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits'.
2021-10-29 20:49:10,849 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits'.
2021-10-29 20:49:10,852 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2021-10-29 20:49:10,852 - stpipe.Detector1Pipeline - INFO - Override for READNOISE reference file is '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/jwst_mirisim_readnoise.fits'.
2021-10-29 20:49:10,853 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is '/grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits'.
2021-10-29 20:49:10,856 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is '/grp/crds/cache/references/jwst/jwst_miri_rscd_0010.fits'.
2021-10-29 20:49:10,858 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits'.
2021-10-29 20:49:10,860 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is 'N/A'.
2021-10-29 20:49:10,861 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2021-10-29 20:49:10,862 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2021-10-29 20:49:10,863 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2021-10-29 20:49:11,371 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:49:11,374 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:49:11,774 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES=1 is a power of 2; correction not needed
2021-10-29 20:49:11,775 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2021-10-29 20:49:11,778 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2021-10-29 20:49:11,868 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:49:11,870 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:49:11,889 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits
2021-10-29 20:49:12,449 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2021-10-29 20:49:12,581 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:49:12,583 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:49:12,602 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits
2021-10-29 20:49:13,496 - stpipe.Detector1Pipeline.saturation - INFO - Detected 24 saturated pixels
2021-10-29 20:49:13,557 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2021-10-29 20:49:13,562 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2021-10-29 20:49:13,696 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:49:13,699 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:49:13,719 - stpipe.Detector1Pipeline.ipc - INFO - Using IPC reference file /grp/crds/cache/references/jwst/jwst_miri_ipc_0009.fits
2021-10-29 20:49:15,403 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2021-10-29 20:49:15,539 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:49:15,541 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:49:15,947 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe done
2021-10-29 20:49:16,080 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:49:16,082 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:49:16,510 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe done
2021-10-29 20:49:16,644 - stpipe.Detector1Pipeline.reset - INFO - Step reset running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:49:16,647 - stpipe.Detector1Pipeline.reset - INFO - Step reset parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:49:16,670 - stpipe.Detector1Pipeline.reset - INFO - Using RESET reference file /grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits
2021-10-29 20:49:17,352 - stpipe.Detector1Pipeline.reset - INFO - Step reset done
2021-10-29 20:49:17,502 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:49:17,504 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:49:17,524 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits
2021-10-29 20:49:18,655 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2021-10-29 20:49:18,795 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:49:18,797 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}
2021-10-29 20:49:18,816 - stpipe.Detector1Pipeline.rscd - INFO - Using RSCD reference file /grp/crds/cache/references/jwst/jwst_miri_rscd_0010.fits
2021-10-29 20:49:19,268 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd done
2021-10-29 20:49:19,407 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:49:19,409 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}
2021-10-29 20:49:19,428 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits
2021-10-29 20:49:21,425 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=3, ngroups=20, nframes=1, groupgap=0
2021-10-29 20:49:21,426 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=2, ngroups=200, nframes=1, groupgap=0
2021-10-29 20:49:22,602 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2021-10-29 20:49:22,951 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:49:22,953 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2021-10-29 20:49:22,954 - stpipe.Detector1Pipeline.refpix - INFO - Step skipped.
2021-10-29 20:49:22,955 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2021-10-29 20:49:23,047 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:49:23,049 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}
2021-10-29 20:49:23,058 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 10 sigma
2021-10-29 20:49:23,069 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2021-10-29 20:49:23,085 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/jwst_mirisim_readnoise.fits
2021-10-29 20:49:23,101 - stpipe.Detector1Pipeline.jump - INFO - Using 1 core for jump detection
2021-10-29 20:49:23,660 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2021-10-29 20:49:24,707 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2021-10-29 20:49:25,857 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 2783 pixels with at least one CR and at least four groups
2021-10-29 20:49:25,858 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and three groups
2021-10-29 20:49:25,859 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 4 pixels with at least one CR and two groups
2021-10-29 20:49:26,048 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 2:
2021-10-29 20:49:27,118 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 1923 pixels with at least one CR and at least four groups
2021-10-29 20:49:27,120 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and three groups
2021-10-29 20:49:27,121 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and two groups
2021-10-29 20:49:27,289 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 3:
2021-10-29 20:49:28,353 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 2041 pixels with at least one CR and at least four groups
2021-10-29 20:49:28,354 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and three groups
2021-10-29 20:49:28,355 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 4 pixels with at least one CR and two groups
2021-10-29 20:49:28,554 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 4.89279 sec
2021-10-29 20:49:28,556 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 5.498844
2021-10-29 20:49:28,560 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2021-10-29 20:49:28,687 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:49:28,689 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2021-10-29 20:49:28,710 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/jwst_mirisim_readnoise.fits
2021-10-29 20:49:28,729 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2021-10-29 20:49:28,746 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2021-10-29 20:49:28,747 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2021-10-29 20:49:28,764 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of leading groups that are flagged as DO_NOT_USE: 1
2021-10-29 20:49:28,766 - stpipe.Detector1Pipeline.ramp_fit - INFO - MIRI dataset has all pixels in the final group flagged as DO_NOT_USE.
2021-10-29 20:50:15,538 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 18
2021-10-29 20:50:15,540 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 3
2021-10-29 20:50:15,641 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2021-10-29 20:50:15,778 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(1024, 1032) from bkg_faint_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:50:15,781 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:50:15,820 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-10-29 20:50:15,821 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-10-29 20:50:15,825 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-10-29 20:50:15,916 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(3, 1024, 1032) from bkg_faint_seq1_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:50:15,918 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:50:15,951 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-10-29 20:50:15,952 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-10-29 20:50:15,955 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-10-29 20:50:16,063 - stpipe.Detector1Pipeline - INFO - Saved model in bkg_faint_seq1_MIRIMAGE_F770Wexp1_rateints.fits
2021-10-29 20:50:16,065 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2021-10-29 20:50:16,127 - stpipe.Detector1Pipeline - INFO - Saved model in bkg_faint_seq1_MIRIMAGE_F770Wexp1_rate.fits
2021-10-29 20:50:16,128 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2021-10-29 20:50:16,136 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2021-10-29 20:50:16,138 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2021-10-29 20:50:16,140 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2021-10-29 20:50:16,141 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2021-10-29 20:50:16,143 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2021-10-29 20:50:16,144 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2021-10-29 20:50:16,146 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2021-10-29 20:50:16,148 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2021-10-29 20:50:16,149 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2021-10-29 20:50:16,150 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2021-10-29 20:50:16,152 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2021-10-29 20:50:16,154 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2021-10-29 20:50:16,157 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2021-10-29 20:50:16,159 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2021-10-29 20:50:16,161 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2021-10-29 20:50:16,163 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2021-10-29 20:50:16,168 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2021-10-29 20:50:16,298 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('bkg_faint_seq2_MIRIMAGE_F770Wexp1.fits',).
2021-10-29 20:50:16,309 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/bkg_faint_seq2_MIRIMAGE_F770Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2021-10-29 20:50:16,622 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'bkg_faint_seq2_MIRIMAGE_F770Wexp1.fits' reftypes = ['dark', 'gain', 'ipc', 'linearity', 'mask', 'persat', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2021-10-29 20:50:16,628 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits'.
2021-10-29 20:50:16,631 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits'.
2021-10-29 20:50:16,632 - stpipe.Detector1Pipeline - INFO - Prefetch for IPC reference file is '/grp/crds/cache/references/jwst/jwst_miri_ipc_0009.fits'.
2021-10-29 20:50:16,634 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits'.
2021-10-29 20:50:16,636 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits'.
2021-10-29 20:50:16,638 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2021-10-29 20:50:16,638 - stpipe.Detector1Pipeline - INFO - Override for READNOISE reference file is '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/jwst_mirisim_readnoise.fits'.
2021-10-29 20:50:16,640 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is '/grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits'.
2021-10-29 20:50:16,642 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is '/grp/crds/cache/references/jwst/jwst_miri_rscd_0010.fits'.
2021-10-29 20:50:16,644 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits'.
2021-10-29 20:50:16,646 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is 'N/A'.
2021-10-29 20:50:16,647 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2021-10-29 20:50:16,648 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2021-10-29 20:50:16,649 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2021-10-29 20:50:17,097 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:50:17,099 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:50:17,513 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES=1 is a power of 2; correction not needed
2021-10-29 20:50:17,514 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2021-10-29 20:50:17,516 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2021-10-29 20:50:17,607 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:50:17,610 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:50:17,629 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits
2021-10-29 20:50:18,192 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2021-10-29 20:50:18,325 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:50:18,328 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:50:18,349 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits
2021-10-29 20:50:19,261 - stpipe.Detector1Pipeline.saturation - INFO - Detected 40 saturated pixels
2021-10-29 20:50:19,324 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2021-10-29 20:50:19,329 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2021-10-29 20:50:19,463 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:50:19,465 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:50:19,485 - stpipe.Detector1Pipeline.ipc - INFO - Using IPC reference file /grp/crds/cache/references/jwst/jwst_miri_ipc_0009.fits
2021-10-29 20:50:21,201 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2021-10-29 20:50:21,336 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:50:21,338 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:50:21,744 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe done
2021-10-29 20:50:21,878 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:50:21,880 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:50:22,310 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe done
2021-10-29 20:50:22,444 - stpipe.Detector1Pipeline.reset - INFO - Step reset running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:50:22,446 - stpipe.Detector1Pipeline.reset - INFO - Step reset parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:50:22,467 - stpipe.Detector1Pipeline.reset - INFO - Using RESET reference file /grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits
2021-10-29 20:50:23,153 - stpipe.Detector1Pipeline.reset - INFO - Step reset done
2021-10-29 20:50:23,306 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:50:23,308 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:50:23,329 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits
2021-10-29 20:50:24,462 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2021-10-29 20:50:24,611 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:50:24,612 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}
2021-10-29 20:50:24,632 - stpipe.Detector1Pipeline.rscd - INFO - Using RSCD reference file /grp/crds/cache/references/jwst/jwst_miri_rscd_0010.fits
2021-10-29 20:50:25,068 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd done
2021-10-29 20:50:25,207 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:50:25,210 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}
2021-10-29 20:50:25,231 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits
2021-10-29 20:50:27,231 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=3, ngroups=20, nframes=1, groupgap=0
2021-10-29 20:50:27,233 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=2, ngroups=200, nframes=1, groupgap=0
2021-10-29 20:50:28,401 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2021-10-29 20:50:28,755 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:50:28,757 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2021-10-29 20:50:28,759 - stpipe.Detector1Pipeline.refpix - INFO - Step skipped.
2021-10-29 20:50:28,761 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2021-10-29 20:50:28,853 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:50:28,855 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}
2021-10-29 20:50:28,866 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 10 sigma
2021-10-29 20:50:28,878 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2021-10-29 20:50:28,896 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/jwst_mirisim_readnoise.fits
2021-10-29 20:50:28,912 - stpipe.Detector1Pipeline.jump - INFO - Using 1 core for jump detection
2021-10-29 20:50:29,471 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2021-10-29 20:50:30,516 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2021-10-29 20:50:31,659 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 2427 pixels with at least one CR and at least four groups
2021-10-29 20:50:31,661 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and three groups
2021-10-29 20:50:31,662 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and two groups
2021-10-29 20:50:31,840 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 2:
2021-10-29 20:50:32,909 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 2153 pixels with at least one CR and at least four groups
2021-10-29 20:50:32,911 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and three groups
2021-10-29 20:50:32,912 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 8 pixels with at least one CR and two groups
2021-10-29 20:50:33,083 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 3:
2021-10-29 20:50:34,143 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 2037 pixels with at least one CR and at least four groups
2021-10-29 20:50:34,144 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and three groups
2021-10-29 20:50:34,145 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 8 pixels with at least one CR and two groups
2021-10-29 20:50:34,364 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 4.8924 sec
2021-10-29 20:50:34,367 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 5.501578
2021-10-29 20:50:34,371 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2021-10-29 20:50:34,515 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:50:34,517 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2021-10-29 20:50:34,537 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/jwst_mirisim_readnoise.fits
2021-10-29 20:50:34,553 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2021-10-29 20:50:34,569 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2021-10-29 20:50:34,570 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2021-10-29 20:50:34,589 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of leading groups that are flagged as DO_NOT_USE: 1
2021-10-29 20:50:34,591 - stpipe.Detector1Pipeline.ramp_fit - INFO - MIRI dataset has all pixels in the final group flagged as DO_NOT_USE.
2021-10-29 20:51:22,007 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 18
2021-10-29 20:51:22,008 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 3
2021-10-29 20:51:22,112 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2021-10-29 20:51:22,249 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(1024, 1032) from bkg_faint_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:51:22,252 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:51:22,295 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-10-29 20:51:22,296 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-10-29 20:51:22,300 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-10-29 20:51:22,392 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(3, 1024, 1032) from bkg_faint_seq2_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:51:22,395 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:51:22,429 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-10-29 20:51:22,430 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-10-29 20:51:22,433 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-10-29 20:51:22,555 - stpipe.Detector1Pipeline - INFO - Saved model in bkg_faint_seq2_MIRIMAGE_F770Wexp1_rateints.fits
2021-10-29 20:51:22,557 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2021-10-29 20:51:22,619 - stpipe.Detector1Pipeline - INFO - Saved model in bkg_faint_seq2_MIRIMAGE_F770Wexp1_rate.fits
2021-10-29 20:51:22,620 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2021-10-29 20:51:22,628 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2021-10-29 20:51:22,630 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2021-10-29 20:51:22,632 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2021-10-29 20:51:22,633 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2021-10-29 20:51:22,635 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2021-10-29 20:51:22,637 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2021-10-29 20:51:22,639 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2021-10-29 20:51:22,641 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2021-10-29 20:51:22,642 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2021-10-29 20:51:22,644 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2021-10-29 20:51:22,645 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2021-10-29 20:51:22,647 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2021-10-29 20:51:22,648 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2021-10-29 20:51:22,649 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2021-10-29 20:51:22,651 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2021-10-29 20:51:22,653 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2021-10-29 20:51:22,655 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2021-10-29 20:51:22,788 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('bkg_faint_seq3_MIRIMAGE_F770Wexp1.fits',).
2021-10-29 20:51:22,798 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/bkg_faint_seq3_MIRIMAGE_F770Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2021-10-29 20:51:23,119 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'bkg_faint_seq3_MIRIMAGE_F770Wexp1.fits' reftypes = ['dark', 'gain', 'ipc', 'linearity', 'mask', 'persat', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2021-10-29 20:51:23,127 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits'.
2021-10-29 20:51:23,129 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits'.
2021-10-29 20:51:23,131 - stpipe.Detector1Pipeline - INFO - Prefetch for IPC reference file is '/grp/crds/cache/references/jwst/jwst_miri_ipc_0009.fits'.
2021-10-29 20:51:23,133 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits'.
2021-10-29 20:51:23,136 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits'.
2021-10-29 20:51:23,139 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2021-10-29 20:51:23,140 - stpipe.Detector1Pipeline - INFO - Override for READNOISE reference file is '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/jwst_mirisim_readnoise.fits'.
2021-10-29 20:51:23,141 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is '/grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits'.
2021-10-29 20:51:23,144 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is '/grp/crds/cache/references/jwst/jwst_miri_rscd_0010.fits'.
2021-10-29 20:51:23,147 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits'.
2021-10-29 20:51:23,149 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is 'N/A'.
2021-10-29 20:51:23,150 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2021-10-29 20:51:23,151 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2021-10-29 20:51:23,152 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2021-10-29 20:51:23,602 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:51:23,604 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:51:24,012 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES=1 is a power of 2; correction not needed
2021-10-29 20:51:24,014 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2021-10-29 20:51:24,016 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2021-10-29 20:51:24,106 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:51:24,108 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:51:24,128 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits
2021-10-29 20:51:24,683 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2021-10-29 20:51:24,816 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:51:24,818 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:51:24,837 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits
2021-10-29 20:51:25,733 - stpipe.Detector1Pipeline.saturation - INFO - Detected 24 saturated pixels
2021-10-29 20:51:25,795 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2021-10-29 20:51:25,800 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2021-10-29 20:51:25,937 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:51:25,940 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:51:25,959 - stpipe.Detector1Pipeline.ipc - INFO - Using IPC reference file /grp/crds/cache/references/jwst/jwst_miri_ipc_0009.fits
2021-10-29 20:51:27,653 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2021-10-29 20:51:27,791 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:51:27,793 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:51:28,206 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe done
2021-10-29 20:51:28,338 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:51:28,340 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:51:28,765 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe done
2021-10-29 20:51:28,899 - stpipe.Detector1Pipeline.reset - INFO - Step reset running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:51:28,901 - stpipe.Detector1Pipeline.reset - INFO - Step reset parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:51:28,925 - stpipe.Detector1Pipeline.reset - INFO - Using RESET reference file /grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits
2021-10-29 20:51:29,603 - stpipe.Detector1Pipeline.reset - INFO - Step reset done
2021-10-29 20:51:29,755 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:51:29,757 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:51:29,777 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits
2021-10-29 20:51:30,895 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2021-10-29 20:51:31,027 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:51:31,029 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}
2021-10-29 20:51:31,055 - stpipe.Detector1Pipeline.rscd - INFO - Using RSCD reference file /grp/crds/cache/references/jwst/jwst_miri_rscd_0010.fits
2021-10-29 20:51:31,496 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd done
2021-10-29 20:51:31,643 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:51:31,645 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}
2021-10-29 20:51:31,664 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits
2021-10-29 20:51:33,656 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=3, ngroups=20, nframes=1, groupgap=0
2021-10-29 20:51:33,659 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=2, ngroups=200, nframes=1, groupgap=0
2021-10-29 20:51:34,816 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2021-10-29 20:51:35,188 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:51:35,190 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2021-10-29 20:51:35,191 - stpipe.Detector1Pipeline.refpix - INFO - Step skipped.
2021-10-29 20:51:35,193 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2021-10-29 20:51:35,284 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:51:35,286 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}
2021-10-29 20:51:35,295 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 10 sigma
2021-10-29 20:51:35,307 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2021-10-29 20:51:35,324 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/jwst_mirisim_readnoise.fits
2021-10-29 20:51:35,339 - stpipe.Detector1Pipeline.jump - INFO - Using 1 core for jump detection
2021-10-29 20:51:35,899 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2021-10-29 20:51:36,954 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2021-10-29 20:51:38,095 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 2607 pixels with at least one CR and at least four groups
2021-10-29 20:51:38,097 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and three groups
2021-10-29 20:51:38,098 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 8 pixels with at least one CR and two groups
2021-10-29 20:51:38,265 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 2:
2021-10-29 20:51:39,318 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 2079 pixels with at least one CR and at least four groups
2021-10-29 20:51:39,320 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and three groups
2021-10-29 20:51:39,321 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and two groups
2021-10-29 20:51:39,491 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 3:
2021-10-29 20:51:40,543 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 2041 pixels with at least one CR and at least four groups
2021-10-29 20:51:40,544 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and three groups
2021-10-29 20:51:40,545 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and two groups
2021-10-29 20:51:40,754 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 4.85438 sec
2021-10-29 20:51:40,758 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 5.462499
2021-10-29 20:51:40,761 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2021-10-29 20:51:40,891 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:51:40,893 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2021-10-29 20:51:40,914 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/jwst_mirisim_readnoise.fits
2021-10-29 20:51:40,933 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2021-10-29 20:51:40,950 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2021-10-29 20:51:40,951 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2021-10-29 20:51:40,969 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of leading groups that are flagged as DO_NOT_USE: 1
2021-10-29 20:51:40,971 - stpipe.Detector1Pipeline.ramp_fit - INFO - MIRI dataset has all pixels in the final group flagged as DO_NOT_USE.
2021-10-29 20:52:27,345 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 18
2021-10-29 20:52:27,348 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 3
2021-10-29 20:52:27,449 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2021-10-29 20:52:27,609 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(1024, 1032) from bkg_faint_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:52:27,611 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:52:27,651 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-10-29 20:52:27,653 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-10-29 20:52:27,656 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-10-29 20:52:27,746 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(3, 1024, 1032) from bkg_faint_seq3_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:52:27,747 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:52:27,780 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-10-29 20:52:27,781 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-10-29 20:52:27,784 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-10-29 20:52:27,890 - stpipe.Detector1Pipeline - INFO - Saved model in bkg_faint_seq3_MIRIMAGE_F770Wexp1_rateints.fits
2021-10-29 20:52:27,891 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2021-10-29 20:52:27,953 - stpipe.Detector1Pipeline - INFO - Saved model in bkg_faint_seq3_MIRIMAGE_F770Wexp1_rate.fits
2021-10-29 20:52:27,955 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2021-10-29 20:52:27,963 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2021-10-29 20:52:27,964 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2021-10-29 20:52:27,966 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2021-10-29 20:52:27,968 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2021-10-29 20:52:27,970 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2021-10-29 20:52:27,972 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2021-10-29 20:52:27,974 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2021-10-29 20:52:27,975 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2021-10-29 20:52:27,977 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2021-10-29 20:52:27,979 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2021-10-29 20:52:27,980 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2021-10-29 20:52:27,982 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2021-10-29 20:52:27,984 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2021-10-29 20:52:27,986 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2021-10-29 20:52:27,987 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2021-10-29 20:52:27,989 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2021-10-29 20:52:27,991 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2021-10-29 20:52:28,118 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('bkg_faint_seq4_MIRIMAGE_F770Wexp1.fits',).
2021-10-29 20:52:28,128 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/bkg_faint_seq4_MIRIMAGE_F770Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2021-10-29 20:52:28,455 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'bkg_faint_seq4_MIRIMAGE_F770Wexp1.fits' reftypes = ['dark', 'gain', 'ipc', 'linearity', 'mask', 'persat', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2021-10-29 20:52:28,462 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits'.
2021-10-29 20:52:28,465 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits'.
2021-10-29 20:52:28,466 - stpipe.Detector1Pipeline - INFO - Prefetch for IPC reference file is '/grp/crds/cache/references/jwst/jwst_miri_ipc_0009.fits'.
2021-10-29 20:52:28,469 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits'.
2021-10-29 20:52:28,471 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits'.
2021-10-29 20:52:28,473 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2021-10-29 20:52:28,474 - stpipe.Detector1Pipeline - INFO - Override for READNOISE reference file is '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/jwst_mirisim_readnoise.fits'.
2021-10-29 20:52:28,475 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is '/grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits'.
2021-10-29 20:52:28,477 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is '/grp/crds/cache/references/jwst/jwst_miri_rscd_0010.fits'.
2021-10-29 20:52:28,480 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits'.
2021-10-29 20:52:28,482 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is 'N/A'.
2021-10-29 20:52:28,483 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2021-10-29 20:52:28,484 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2021-10-29 20:52:28,485 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2021-10-29 20:52:28,936 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:52:28,938 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:52:29,342 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES=1 is a power of 2; correction not needed
2021-10-29 20:52:29,344 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2021-10-29 20:52:29,346 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2021-10-29 20:52:29,437 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:52:29,439 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:52:29,457 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits
2021-10-29 20:52:30,051 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2021-10-29 20:52:30,185 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:52:30,187 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:52:30,205 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits
2021-10-29 20:52:31,097 - stpipe.Detector1Pipeline.saturation - INFO - Detected 44 saturated pixels
2021-10-29 20:52:31,158 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2021-10-29 20:52:31,163 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2021-10-29 20:52:31,299 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:52:31,301 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:52:31,321 - stpipe.Detector1Pipeline.ipc - INFO - Using IPC reference file /grp/crds/cache/references/jwst/jwst_miri_ipc_0009.fits
2021-10-29 20:52:33,008 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2021-10-29 20:52:33,146 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:52:33,148 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:52:33,550 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe done
2021-10-29 20:52:33,684 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:52:33,686 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:52:34,107 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe done
2021-10-29 20:52:34,242 - stpipe.Detector1Pipeline.reset - INFO - Step reset running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:52:34,245 - stpipe.Detector1Pipeline.reset - INFO - Step reset parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:52:34,265 - stpipe.Detector1Pipeline.reset - INFO - Using RESET reference file /grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits
2021-10-29 20:52:34,942 - stpipe.Detector1Pipeline.reset - INFO - Step reset done
2021-10-29 20:52:35,094 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:52:35,096 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:52:35,115 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits
2021-10-29 20:52:36,240 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2021-10-29 20:52:36,369 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:52:36,371 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}
2021-10-29 20:52:36,390 - stpipe.Detector1Pipeline.rscd - INFO - Using RSCD reference file /grp/crds/cache/references/jwst/jwst_miri_rscd_0010.fits
2021-10-29 20:52:36,829 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd done
2021-10-29 20:52:36,985 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:52:36,986 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}
2021-10-29 20:52:37,006 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits
2021-10-29 20:52:39,008 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=3, ngroups=20, nframes=1, groupgap=0
2021-10-29 20:52:39,010 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=2, ngroups=200, nframes=1, groupgap=0
2021-10-29 20:52:40,189 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2021-10-29 20:52:40,540 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:52:40,542 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2021-10-29 20:52:40,543 - stpipe.Detector1Pipeline.refpix - INFO - Step skipped.
2021-10-29 20:52:40,544 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2021-10-29 20:52:40,638 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:52:40,640 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}
2021-10-29 20:52:40,649 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 10 sigma
2021-10-29 20:52:40,661 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2021-10-29 20:52:40,681 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/jwst_mirisim_readnoise.fits
2021-10-29 20:52:40,696 - stpipe.Detector1Pipeline.jump - INFO - Using 1 core for jump detection
2021-10-29 20:52:41,257 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2021-10-29 20:52:42,303 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2021-10-29 20:52:43,467 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 2608 pixels with at least one CR and at least four groups
2021-10-29 20:52:43,468 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and three groups
2021-10-29 20:52:43,469 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and two groups
2021-10-29 20:52:43,647 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 2:
2021-10-29 20:52:44,719 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 2086 pixels with at least one CR and at least four groups
2021-10-29 20:52:44,721 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and three groups
2021-10-29 20:52:44,722 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 8 pixels with at least one CR and two groups
2021-10-29 20:52:44,891 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 3:
2021-10-29 20:52:45,953 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 1949 pixels with at least one CR and at least four groups
2021-10-29 20:52:45,955 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and three groups
2021-10-29 20:52:45,955 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 0 pixels with at least one CR and two groups
2021-10-29 20:52:46,159 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 4.9006 sec
2021-10-29 20:52:46,162 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 5.513197
2021-10-29 20:52:46,165 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2021-10-29 20:52:46,297 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(3, 20, 1024, 1032) from bkg_faint_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:52:46,299 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2021-10-29 20:52:46,320 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpbpubkxz8/jwst_mirisim_readnoise.fits
2021-10-29 20:52:46,336 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2021-10-29 20:52:46,353 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2021-10-29 20:52:46,354 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2021-10-29 20:52:46,372 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of leading groups that are flagged as DO_NOT_USE: 1
2021-10-29 20:52:46,374 - stpipe.Detector1Pipeline.ramp_fit - INFO - MIRI dataset has all pixels in the final group flagged as DO_NOT_USE.
2021-10-29 20:53:33,320 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 18
2021-10-29 20:53:33,323 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 3
2021-10-29 20:53:33,427 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2021-10-29 20:53:33,593 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(1024, 1032) from bkg_faint_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:53:33,595 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:53:33,640 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-10-29 20:53:33,641 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-10-29 20:53:33,644 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-10-29 20:53:33,735 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(3, 1024, 1032) from bkg_faint_seq4_MIRIMAGE_F770Wexp1.fits>,).
2021-10-29 20:53:33,737 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': ''}
2021-10-29 20:53:33,771 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-10-29 20:53:33,772 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-10-29 20:53:33,775 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-10-29 20:53:33,892 - stpipe.Detector1Pipeline - INFO - Saved model in bkg_faint_seq4_MIRIMAGE_F770Wexp1_rateints.fits
2021-10-29 20:53:33,894 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2021-10-29 20:53:33,959 - stpipe.Detector1Pipeline - INFO - Saved model in bkg_faint_seq4_MIRIMAGE_F770Wexp1_rate.fits
2021-10-29 20:53:33,960 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
Detector 1 steps completed on all files. Science files: [<ImageModel(1024, 1032) from starfield_med_seq1_MIRIMAGE_F770Wexp1_rate.fits>, <ImageModel(1024, 1032) from starfield_med_seq2_MIRIMAGE_F770Wexp1_rate.fits>, <ImageModel(1024, 1032) from starfield_med_seq3_MIRIMAGE_F770Wexp1_rate.fits>, <ImageModel(1024, 1032) from starfield_med_seq4_MIRIMAGE_F770Wexp1_rate.fits>] Background files: [<ImageModel(1024, 1032) from bkg_faint_seq1_MIRIMAGE_F770Wexp1_rate.fits>, <ImageModel(1024, 1032) from bkg_faint_seq2_MIRIMAGE_F770Wexp1_rate.fits>, <ImageModel(1024, 1032) from bkg_faint_seq3_MIRIMAGE_F770Wexp1_rate.fits>, <ImageModel(1024, 1032) from bkg_faint_seq4_MIRIMAGE_F770Wexp1_rate.fits>]
Display the rate science images and background images to see locations of sources.
# Look at science images
for image in scislopelist:
im = ImageModel(image)
plt.figure(figsize=(20,20))
plt.imshow(im.data, cmap='rainbow', origin='lower', vmin=0,vmax=10)
plt.colorbar()
plt.show()
print('background region values', im.data[850, 500])
background region values 6.088285
background region values 6.3407393
background region values 6.6889668
background region values 6.4471617
# Look at background images
# Pixel to examine that should have a source in at least one background image
xval = 615
yval = 317
for backimage in bkgslopelist:
bkgim = ImageModel(backimage)
print(bkgim.meta.filename)
selectedstar = bkgim.data[yval, xval] # Choose a pixel that is on a source in at least one image
plt.figure(figsize=(20,20))
plt.imshow(bkgim.data, cmap='rainbow', origin='lower', vmin=0,vmax=10)
plt.colorbar()
plt.show()
print('brightness of selected pixel', selectedstar, '\n')
bkg_faint_seq1_MIRIMAGE_F770Wexp1_rate.fits
brightness of selected pixel 44.993366 bkg_faint_seq2_MIRIMAGE_F770Wexp1_rate.fits
brightness of selected pixel 6.191513 bkg_faint_seq3_MIRIMAGE_F770Wexp1_rate.fits
brightness of selected pixel 6.1969266 bkg_faint_seq4_MIRIMAGE_F770Wexp1_rate.fits
brightness of selected pixel 6.2866673
# Create an association file of all of the rate files
asn_files = [scislopelist[0].meta.filename, scislopelist[1].meta.filename, scislopelist[2].meta.filename,
scislopelist[3].meta.filename]
bgr_files = [bkgslopelist[0].meta.filename, bkgslopelist[1].meta.filename, bkgslopelist[2].meta.filename,
bkgslopelist[3].meta.filename]
asn = asn_from_list.asn_from_list(asn_files, rule=DMSLevel2bBase, meta={'program':'test', 'target':'randomfield', 'asn_pool':'test'})
# now add the opposite nod as background exposure:
for product in asn['products']:
product['members'].append({'expname':bgr_files[0], 'exptype':'background'})
product['members'].append({'expname':bgr_files[1], 'exptype':'background'})
product['members'].append({'expname':bgr_files[2], 'exptype':'background'})
product['members'].append({'expname':bgr_files[3], 'exptype':'background'})
# write this out to a json file
with open('imager_bkgsubtest_asn.json', 'w') as fp:
fp.write(asn.dump()[1])
The default value of sigma for the background subtract step is set to 3, but may need to be adjusted downward to 2 or 1 in order to actually sigma clip the sources in the images. Test this for your data. For this particular data set, 2 is sufficient, but for brighter sources, 1 may be the best option.
pipe2 = Image2Pipeline()
# Set pipeline parameters
pipe2.save_results = True
pipe2.bkg_subtract.sigma = 2 # Set this in order to catch the outliers and leave only background
pipe2.bkg_subtract.maxiters = 3
pipe2.bkg_subtract.save_combined_background = True
pipe2.assign_wcs.skip = True
pipe2.flat_field.skip = True
pipe2.photom.skip = True
pipe2.resample.skip = True
pipe2.save_bsub = True
pipe2.run('imager_bkgsubtest_asn.json')
2021-10-29 20:53:39,830 - stpipe.Image2Pipeline - INFO - Image2Pipeline instance created.
2021-10-29 20:53:39,834 - stpipe.Image2Pipeline.bkg_subtract - INFO - BackgroundStep instance created.
2021-10-29 20:53:39,836 - stpipe.Image2Pipeline.assign_wcs - INFO - AssignWcsStep instance created.
2021-10-29 20:53:39,838 - stpipe.Image2Pipeline.flat_field - INFO - FlatFieldStep instance created.
2021-10-29 20:53:39,840 - stpipe.Image2Pipeline.photom - INFO - PhotomStep instance created.
2021-10-29 20:53:39,842 - stpipe.Image2Pipeline.resample - INFO - ResampleStep instance created.
2021-10-29 20:53:40,001 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline running with args ('imager_bkgsubtest_asn.json',).
2021-10-29 20:53:40,005 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_bsub': True, 'steps': {'bkg_subtract': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_combined_background': True, 'sigma': 2, 'maxiters': 3}, 'assign_wcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}, 'flat_field': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}, 'photom': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}}}
2021-10-29 20:53:40,056 - stpipe.Image2Pipeline - INFO - Prefetching reference files for dataset: 'starfield_med_seq1_MIRIMAGE_F770Wexp1_rate.fits' reftypes = ['wavelengthrange', 'wfssbkg']
2021-10-29 20:53:40,060 - stpipe.Image2Pipeline - INFO - Prefetch for WAVELENGTHRANGE reference file is 'N/A'.
2021-10-29 20:53:40,061 - stpipe.Image2Pipeline - INFO - Prefetch for WFSSBKG reference file is 'N/A'.
2021-10-29 20:53:40,062 - stpipe.Image2Pipeline - INFO - Starting calwebb_image2 ...
2021-10-29 20:53:40,071 - stpipe.Image2Pipeline - INFO - Processing product starfield_med_seq1_MIRIMAGE_F770Wexp1
2021-10-29 20:53:40,072 - stpipe.Image2Pipeline - INFO - Working on input starfield_med_seq1_MIRIMAGE_F770Wexp1_rate.fits ...
2021-10-29 20:53:40,194 - stpipe.Image2Pipeline.bkg_subtract - INFO - Step bkg_subtract running with args (<ImageModel(1024, 1032) from starfield_med_seq1_MIRIMAGE_F770Wexp1_rate.fits>, ['bkg_faint_seq1_MIRIMAGE_F770Wexp1_rate.fits', 'bkg_faint_seq2_MIRIMAGE_F770Wexp1_rate.fits', 'bkg_faint_seq3_MIRIMAGE_F770Wexp1_rate.fits', 'bkg_faint_seq4_MIRIMAGE_F770Wexp1_rate.fits']).
2021-10-29 20:53:40,196 - stpipe.Image2Pipeline.bkg_subtract - INFO - Step bkg_subtract parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'bsub', 'search_output_file': True, 'input_dir': '', 'save_combined_background': True, 'sigma': 2, 'maxiters': 3}
2021-10-29 20:53:40,723 - stpipe.Image2Pipeline.bkg_subtract - INFO - Saved model in starfield_med_seq1_MIRIMAGE_F770Wexp1_combinedbackground.fits
2021-10-29 20:53:40,725 - stpipe.Image2Pipeline.bkg_subtract - INFO - Combined background written to "starfield_med_seq1_MIRIMAGE_F770Wexp1_combinedbackground.fits".
2021-10-29 20:53:40,786 - stpipe.Image2Pipeline.bkg_subtract - INFO - Saved model in starfield_med_seq1_MIRIMAGE_F770Wexp1_bsub.fits
2021-10-29 20:53:40,787 - stpipe.Image2Pipeline.bkg_subtract - INFO - Step bkg_subtract done
2021-10-29 20:53:40,889 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_med_seq1_MIRIMAGE_F770Wexp1_bsub.fits>,).
2021-10-29 20:53:40,891 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2021-10-29 20:53:40,892 - stpipe.Image2Pipeline.assign_wcs - INFO - Step skipped.
2021-10-29 20:53:40,894 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2021-10-29 20:53:40,976 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_med_seq1_MIRIMAGE_F770Wexp1_bsub.fits>,).
2021-10-29 20:53:40,978 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2021-10-29 20:53:40,979 - stpipe.Image2Pipeline.flat_field - INFO - Step skipped.
2021-10-29 20:53:40,983 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2021-10-29 20:53:41,061 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_med_seq1_MIRIMAGE_F770Wexp1_bsub.fits>,).
2021-10-29 20:53:41,063 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2021-10-29 20:53:41,064 - stpipe.Image2Pipeline.photom - INFO - Step skipped.
2021-10-29 20:53:41,066 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2021-10-29 20:53:41,143 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_med_seq1_MIRIMAGE_F770Wexp1_bsub.fits>,).
2021-10-29 20:53:41,145 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': True, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}
2021-10-29 20:53:41,146 - stpipe.Image2Pipeline.resample - INFO - Step skipped.
2021-10-29 20:53:41,148 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2021-10-29 20:53:41,149 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_med_seq1_MIRIMAGE_F770Wexp1
2021-10-29 20:53:41,150 - stpipe.Image2Pipeline - INFO - Processing product starfield_med_seq2_MIRIMAGE_F770Wexp1
2021-10-29 20:53:41,151 - stpipe.Image2Pipeline - INFO - Working on input starfield_med_seq2_MIRIMAGE_F770Wexp1_rate.fits ...
2021-10-29 20:53:41,270 - stpipe.Image2Pipeline.bkg_subtract - INFO - Step bkg_subtract running with args (<ImageModel(1024, 1032) from starfield_med_seq2_MIRIMAGE_F770Wexp1_rate.fits>, ['bkg_faint_seq1_MIRIMAGE_F770Wexp1_rate.fits', 'bkg_faint_seq2_MIRIMAGE_F770Wexp1_rate.fits', 'bkg_faint_seq3_MIRIMAGE_F770Wexp1_rate.fits', 'bkg_faint_seq4_MIRIMAGE_F770Wexp1_rate.fits']).
2021-10-29 20:53:41,271 - stpipe.Image2Pipeline.bkg_subtract - INFO - Step bkg_subtract parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'bsub', 'search_output_file': True, 'input_dir': '', 'save_combined_background': True, 'sigma': 2, 'maxiters': 3}
2021-10-29 20:53:41,811 - stpipe.Image2Pipeline.bkg_subtract - INFO - Saved model in starfield_med_seq2_MIRIMAGE_F770Wexp1_combinedbackground.fits
2021-10-29 20:53:41,812 - stpipe.Image2Pipeline.bkg_subtract - INFO - Combined background written to "starfield_med_seq2_MIRIMAGE_F770Wexp1_combinedbackground.fits".
2021-10-29 20:53:41,874 - stpipe.Image2Pipeline.bkg_subtract - INFO - Saved model in starfield_med_seq2_MIRIMAGE_F770Wexp1_bsub.fits
2021-10-29 20:53:41,875 - stpipe.Image2Pipeline.bkg_subtract - INFO - Step bkg_subtract done
2021-10-29 20:53:41,975 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_med_seq2_MIRIMAGE_F770Wexp1_bsub.fits>,).
2021-10-29 20:53:41,978 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': 'assign_wcs', 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2021-10-29 20:53:41,979 - stpipe.Image2Pipeline.assign_wcs - INFO - Step skipped.
2021-10-29 20:53:41,981 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2021-10-29 20:53:42,067 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_med_seq2_MIRIMAGE_F770Wexp1_bsub.fits>,).
2021-10-29 20:53:42,069 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': 'flat_field', 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2021-10-29 20:53:42,070 - stpipe.Image2Pipeline.flat_field - INFO - Step skipped.
2021-10-29 20:53:42,072 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2021-10-29 20:53:42,151 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_med_seq2_MIRIMAGE_F770Wexp1_bsub.fits>,).
2021-10-29 20:53:42,153 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': 'photom', 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2021-10-29 20:53:42,155 - stpipe.Image2Pipeline.photom - INFO - Step skipped.
2021-10-29 20:53:42,156 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2021-10-29 20:53:42,235 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_med_seq2_MIRIMAGE_F770Wexp1_bsub.fits>,).
2021-10-29 20:53:42,238 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': True, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}
2021-10-29 20:53:42,238 - stpipe.Image2Pipeline.resample - INFO - Step skipped.
2021-10-29 20:53:42,240 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2021-10-29 20:53:42,241 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_med_seq2_MIRIMAGE_F770Wexp1
2021-10-29 20:53:42,243 - stpipe.Image2Pipeline - INFO - Processing product starfield_med_seq3_MIRIMAGE_F770Wexp1
2021-10-29 20:53:42,243 - stpipe.Image2Pipeline - INFO - Working on input starfield_med_seq3_MIRIMAGE_F770Wexp1_rate.fits ...
2021-10-29 20:53:42,360 - stpipe.Image2Pipeline.bkg_subtract - INFO - Step bkg_subtract running with args (<ImageModel(1024, 1032) from starfield_med_seq3_MIRIMAGE_F770Wexp1_rate.fits>, ['bkg_faint_seq1_MIRIMAGE_F770Wexp1_rate.fits', 'bkg_faint_seq2_MIRIMAGE_F770Wexp1_rate.fits', 'bkg_faint_seq3_MIRIMAGE_F770Wexp1_rate.fits', 'bkg_faint_seq4_MIRIMAGE_F770Wexp1_rate.fits']).
2021-10-29 20:53:42,361 - stpipe.Image2Pipeline.bkg_subtract - INFO - Step bkg_subtract parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'bsub', 'search_output_file': True, 'input_dir': '', 'save_combined_background': True, 'sigma': 2, 'maxiters': 3}
2021-10-29 20:53:42,878 - stpipe.Image2Pipeline.bkg_subtract - INFO - Saved model in starfield_med_seq3_MIRIMAGE_F770Wexp1_combinedbackground.fits
2021-10-29 20:53:42,879 - stpipe.Image2Pipeline.bkg_subtract - INFO - Combined background written to "starfield_med_seq3_MIRIMAGE_F770Wexp1_combinedbackground.fits".
2021-10-29 20:53:42,940 - stpipe.Image2Pipeline.bkg_subtract - INFO - Saved model in starfield_med_seq3_MIRIMAGE_F770Wexp1_bsub.fits
2021-10-29 20:53:42,941 - stpipe.Image2Pipeline.bkg_subtract - INFO - Step bkg_subtract done
2021-10-29 20:53:43,042 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_med_seq3_MIRIMAGE_F770Wexp1_bsub.fits>,).
2021-10-29 20:53:43,044 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': 'assign_wcs', 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2021-10-29 20:53:43,045 - stpipe.Image2Pipeline.assign_wcs - INFO - Step skipped.
2021-10-29 20:53:43,047 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2021-10-29 20:53:43,134 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_med_seq3_MIRIMAGE_F770Wexp1_bsub.fits>,).
2021-10-29 20:53:43,136 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': 'flat_field', 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2021-10-29 20:53:43,137 - stpipe.Image2Pipeline.flat_field - INFO - Step skipped.
2021-10-29 20:53:43,140 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2021-10-29 20:53:43,220 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_med_seq3_MIRIMAGE_F770Wexp1_bsub.fits>,).
2021-10-29 20:53:43,222 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': 'photom', 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2021-10-29 20:53:43,223 - stpipe.Image2Pipeline.photom - INFO - Step skipped.
2021-10-29 20:53:43,225 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2021-10-29 20:53:43,304 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_med_seq3_MIRIMAGE_F770Wexp1_bsub.fits>,).
2021-10-29 20:53:43,306 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': True, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}
2021-10-29 20:53:43,307 - stpipe.Image2Pipeline.resample - INFO - Step skipped.
2021-10-29 20:53:43,309 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2021-10-29 20:53:43,310 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_med_seq3_MIRIMAGE_F770Wexp1
2021-10-29 20:53:43,311 - stpipe.Image2Pipeline - INFO - Processing product starfield_med_seq4_MIRIMAGE_F770Wexp1
2021-10-29 20:53:43,312 - stpipe.Image2Pipeline - INFO - Working on input starfield_med_seq4_MIRIMAGE_F770Wexp1_rate.fits ...
2021-10-29 20:53:43,432 - stpipe.Image2Pipeline.bkg_subtract - INFO - Step bkg_subtract running with args (<ImageModel(1024, 1032) from starfield_med_seq4_MIRIMAGE_F770Wexp1_rate.fits>, ['bkg_faint_seq1_MIRIMAGE_F770Wexp1_rate.fits', 'bkg_faint_seq2_MIRIMAGE_F770Wexp1_rate.fits', 'bkg_faint_seq3_MIRIMAGE_F770Wexp1_rate.fits', 'bkg_faint_seq4_MIRIMAGE_F770Wexp1_rate.fits']).
2021-10-29 20:53:43,434 - stpipe.Image2Pipeline.bkg_subtract - INFO - Step bkg_subtract parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'bsub', 'search_output_file': True, 'input_dir': '', 'save_combined_background': True, 'sigma': 2, 'maxiters': 3}
2021-10-29 20:53:43,946 - stpipe.Image2Pipeline.bkg_subtract - INFO - Saved model in starfield_med_seq4_MIRIMAGE_F770Wexp1_combinedbackground.fits
2021-10-29 20:53:43,947 - stpipe.Image2Pipeline.bkg_subtract - INFO - Combined background written to "starfield_med_seq4_MIRIMAGE_F770Wexp1_combinedbackground.fits".
2021-10-29 20:53:44,017 - stpipe.Image2Pipeline.bkg_subtract - INFO - Saved model in starfield_med_seq4_MIRIMAGE_F770Wexp1_bsub.fits
2021-10-29 20:53:44,018 - stpipe.Image2Pipeline.bkg_subtract - INFO - Step bkg_subtract done
2021-10-29 20:53:44,119 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_med_seq4_MIRIMAGE_F770Wexp1_bsub.fits>,).
2021-10-29 20:53:44,121 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': 'assign_wcs', 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2021-10-29 20:53:44,122 - stpipe.Image2Pipeline.assign_wcs - INFO - Step skipped.
2021-10-29 20:53:44,124 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2021-10-29 20:53:44,206 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_med_seq4_MIRIMAGE_F770Wexp1_bsub.fits>,).
2021-10-29 20:53:44,208 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': 'flat_field', 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2021-10-29 20:53:44,209 - stpipe.Image2Pipeline.flat_field - INFO - Step skipped.
2021-10-29 20:53:44,210 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2021-10-29 20:53:44,291 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_med_seq4_MIRIMAGE_F770Wexp1_bsub.fits>,).
2021-10-29 20:53:44,292 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': 'photom', 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2021-10-29 20:53:44,293 - stpipe.Image2Pipeline.photom - INFO - Step skipped.
2021-10-29 20:53:44,296 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2021-10-29 20:53:44,376 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_med_seq4_MIRIMAGE_F770Wexp1_bsub.fits>,).
2021-10-29 20:53:44,378 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': True, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'pixel_scale_ratio': 1.0, 'single': False, 'blendheaders': True, 'allowed_memory': None}
2021-10-29 20:53:44,379 - stpipe.Image2Pipeline.resample - INFO - Step skipped.
2021-10-29 20:53:44,381 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2021-10-29 20:53:44,382 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_med_seq4_MIRIMAGE_F770Wexp1
2021-10-29 20:53:44,384 - stpipe.Image2Pipeline - INFO - ... ending calwebb_image2
2021-10-29 20:53:44,454 - stpipe.Image2Pipeline - INFO - Saved model in starfield_med_seq1_MIRIMAGE_F770Wexp1_cal.fits
2021-10-29 20:53:44,516 - stpipe.Image2Pipeline - INFO - Saved model in starfield_med_seq2_MIRIMAGE_F770Wexp1_cal.fits
2021-10-29 20:53:44,576 - stpipe.Image2Pipeline - INFO - Saved model in starfield_med_seq3_MIRIMAGE_F770Wexp1_cal.fits
2021-10-29 20:53:44,635 - stpipe.Image2Pipeline - INFO - Saved model in starfield_med_seq4_MIRIMAGE_F770Wexp1_cal.fits
2021-10-29 20:53:44,636 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline done
[<ImageModel(1024, 1032) from starfield_med_seq1_MIRIMAGE_F770Wexp1_cal.fits>, <ImageModel(1024, 1032) from starfield_med_seq2_MIRIMAGE_F770Wexp1_cal.fits>, <ImageModel(1024, 1032) from starfield_med_seq3_MIRIMAGE_F770Wexp1_cal.fits>, <ImageModel(1024, 1032) from starfield_med_seq4_MIRIMAGE_F770Wexp1_cal.fits>]
See how well the sigma clipping did at removing the sources from the background image. If the sources in the background image are bright, the value of sigma should be set to 1. If the sources are faint enough, the default value of 3 should be good enough.
Also look at the value of a specific pixel in the averaged image, one that has a source in at least one of the background images, to see if the flux was adequately removed in the sigma clipping process.
# This can only be uncommented in builds after 7.7.1
averaged_backgrounds = glob.glob('*combinedbackground.fits')
print(averaged_backgrounds)
avgbkg = ImageModel(averaged_backgrounds[0])
selectedavgstar = avgbkg.data[yval, xval] # Choose a pixel location that contains a source in at least one background image
plt.figure(figsize=(20,20))
plt.imshow(avgbkg.data, cmap='rainbow', origin='lower', vmin=0,vmax=10)
plt.colorbar()
plt.show()
print('brightness of selected pixel', selectedavgstar)
['starfield_med_seq1_MIRIMAGE_F770Wexp1_combinedbackground.fits', 'starfield_med_seq2_MIRIMAGE_F770Wexp1_combinedbackground.fits', 'starfield_med_seq3_MIRIMAGE_F770Wexp1_combinedbackground.fits', 'starfield_med_seq4_MIRIMAGE_F770Wexp1_combinedbackground.fits']
brightness of selected pixel 6.1942196
Look at the values of pixels in the background images at the location of one of the stars to see whether the star flux is being rejected as part of the sigma clipping. In calwebb_image2, the sigma value was set to 2, which is lower than the default value of 3. This allows the most pixels to be rejected as outliers, and should leave only the background values in the final averaged image.
### Check averaging of background images
print(bkgslopelist,'\n')
im1 = ImageModel(bkgslopelist[0])
im2 = ImageModel(bkgslopelist[1])
im3 = ImageModel(bkgslopelist[2])
im4 = ImageModel(bkgslopelist[3])
print('Value in image1 ', im1.data[yval, xval])
print('Value in image2 ', im2.data[yval, xval])
print('Value in image3 ', im3.data[yval, xval])
print('Value in image4 ', im4.data[yval, xval],'\n')
avgvalue = (im1.data[yval, xval]+ im2.data[yval, xval] + im3.data[yval, xval] + im4.data[yval, xval])/4
print('Averaged value = ', avgvalue)
print()
print('Brightness of selected pixel in averaged image', selectedavgstar)
[<ImageModel(1024, 1032) from bkg_faint_seq1_MIRIMAGE_F770Wexp1_rate.fits>, <ImageModel(1024, 1032) from bkg_faint_seq2_MIRIMAGE_F770Wexp1_rate.fits>, <ImageModel(1024, 1032) from bkg_faint_seq3_MIRIMAGE_F770Wexp1_rate.fits>, <ImageModel(1024, 1032) from bkg_faint_seq4_MIRIMAGE_F770Wexp1_rate.fits>] Value in image1 44.993366 Value in image2 6.191513 Value in image3 6.1969266 Value in image4 6.2866673 Averaged value = 15.917118072509766 Brightness of selected pixel in averaged image 6.1942196
# Look at background image
subtracted_images = glob.glob('*bsub.fits')
for bkgsubimage in subtracted_images:
bkgsub = ImageModel(bkgsubimage)
plt.figure(figsize=(20,20))
plt.imshow(bkgsub.data, cmap='rainbow', origin='lower', vmin=-1,vmax=5)
plt.colorbar()
plt.show()
print('background region values', bkgsub.data[850, 500])
try:
np.testing.assert_allclose(bkgsub.data[850, 500], 0.01, atol=0.8)
print('Background subtraction test PASSED: background is near zero')
except AssertionError as e:
print('Test FAILED: Subtracted background value is not near zero')
background region values -0.0116381645 Background subtraction test PASSED: background is near zero
background region values 0.24081612 Background subtraction test PASSED: background is near zero
background region values 0.5890436 Background subtraction test PASSED: background is near zero
background region values 0.34723854 Background subtraction test PASSED: background is near zero
Examine the images shown and the pixel values reported through the notebook. If the averaged background image is subtracted from the science images (subtracted background values near 0), and the averaged background image shows a smooth background with the sources removed, then this test passes. The four background images should be averaged together after the sources were rejected via sigma clipping. Check that the subtracted background values are near 0.
Author: M Cracraft, Senior Staff Scientist, INS/MIRI branch
Updated On: 06/09/2021